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Signs Taken for Wonders: 
AI, Art & the Matter of Race 


Michele Elam 


AI shares with earlier socially transformative technologies a reliance on limiting 
models of the “human” that embed racialized metrics for human achievement, ex- 
pression, and progress. Many of these fundamental mindsets about what constitutes 
humanity have become institutionally codified, continuing to mushroom in design 
practices and research development of devices, applications, and platforms despite 
the best efforts of many well-intentioned technologists, scholars, policy-makers, and 
industries. This essay argues why and how AI needs to be much more deeply integrat- 
ed with the humanities and arts in order to contribute to human flourishing, par- 
ticularly with regard to social justice. Informed by decolonial, disability, and gen- 
der critical frameworks, some AI artist-technologists of color challenge commercial 
imperatives of “personalization” and “frictionlessness,” representing race, ethnicity, 
and gender not as normative self-evident categories nor monetized data points, but 
as dynamic social processes always indexing political tensions and interests. 


As he grew accustomed to the great gallery of machines, he began to feel 
the forty-foot dynamos as a moral force, much as the early Christians 
felt the Cross. The planet itself felt less impressive, in its old-fashioned, 
deliberate, annual or daily revolution, than this huge wheel, revolving 
within arm’s length at some vertiginous speed, and barely murmur- 
ing — scarcely - humming an audible warning to stand a hair’s breadth 
further for respect of power, while it would not wake the baby lying 
close against its frame. Before the end, one began to pray to it; inherited 
instinct taught the natural expression of man before silent and infinite 
force. Among the thousand symbols of ultimate energy the dynamo was 
not so human as some, but it was the most expressive. 


1 


—Henry Adams, “The Virgin and the Dynamo” 


n astonishment of the new technologies at the turn into the twentieth cen- 
tury, the renowned historian Henry Adams found the Gallery of the Electric 
Machines “physics stark mad in metaphysics” and wondered at their pro- 
found hold on the cultural imagination.” The dynamo that so moved and unset- 
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tled Adams was a new generator of unprecedented scale, a machine responsible 
for powering the first electrified world’s fair in 1893, a purportedly spectacular 
event presided over by President Glover Cleveland. Its power was invisible but 
the more potent for it: “No more relation could he discover between the steam 
and the electric current than between the cross and the cathedral. The forces were 
interchangeable if not reversible, but he could see only an absolute fiat in elec- 
tricity as in faith.” For Adams, the dynamo’s effect in the world was akin to evi- 
dence of things unseen like the symbols of the Virgin or the cross, imperceptible 
but world-transforming currents with implications both worldly and spiritual. 

I open with this discussion of the world’s fair at the fin de siecle because Ad- 
ams’s dynamo is our GPT-3 (Generative Pre-trained Transformer 3), a language 
model that uses deep learning to produce text/speech/responses that can appear 
generated by a human. His exhilaration — hand-in-glove with his existential verti- 
go — and his internal conflict similarly speak to our contemporary aspirations for 
and anxieties about artificial intelligence. Adams understood that the turn to such 
formidable technology represented a thrilling but cataclysmic event, “his histori- 
cal neck broken by the sudden irruption of forces entirely new.” Although human 
grappling with exponential leaps in technology dates at least to the medieval peri- 
od, this particular historical precedent of a transformational moment is singular- 
ly relevant for our contemporary moment: there’s a direct line between Adams's 
concern with the hagiography of tech, the devaluation of the arts and humanities, 
and the comingling of scientific development with (racialized, ableist) narratives 
of progress to current debates about those nearly identical phenomena today. The 
consequences of those fundamental mindsets and practices, institutionally codi- 
fied over time, continue to mushroom in devices, applications, platforms, design 
practices, and research development. Unacknowledged or misunderstood, they 
will continue to persist despite the best efforts of many well-intentioned technol- 
ogists, scholars, policy-makers, and industries that still tend to frame and limit 
questions of fairness and bias in terms “safety,” which can mute or obscure atten- 
tion to issues of equity, justice, or power.3 

Significantly, Adams’s response to the dynamo is neither apocalyptic jeremiad 
nor in the genre of salvation: that is, his concerns fell beyond the pale of narratives 
of dystopia or deliverance. He was no technophobe; in fact, he deeply admired sci- 
entific advances of all kinds. Rather, his ambivalence has to do with the inestima- 
ble psychological and spiritual sway of machines so impressive that “the planet itself 
felt less impressive,” even “old-fashioned.”4 That something man-made might 
seem so glorious as to overshadow creation, seemed so evocative of the infinite 
that people felt out of step with their own times. For Adams, those experiences 
signaled an epistemic break that rendered people especially receptive and open to 
change, but also vulnerable to idolizing false gods of a sort. He saw that the dyna- 
mo was quickly acquiring a kind of cult status, inviting supplication and reverence 
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Figure 1 
Gallery of the Electric Machines, The Great Exposition, 
1900 Paris World’s Fair 
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LA GALERIE DES MACHINES ÉLECTRIQUES (FRANCE) 


Source: La Galerie des Machines Electriques at the Fifth Paris International Exposition of 
1900. Image from Dynamo Exhibition Gallery of France, https ://www.ndl.go.jp/exposition/ 
e/data/L/428].html. 


by its followers. The latest technology, as he personified it in his poem “Prayer to 
the Dynamo,” was simultaneously a “Mysterious Power! Gentle Friend! Despotic 
Master! Tireless Force!”> Adams experienced awe in the presence of the dynamo: 
“awe” as the eighteenth-century philosopher Edmund Burke meant the term, 
as being overcome by the terror and beauty of the sublime. And being tech awe- 
struck, he also instantly presaged many of his generation’s — and I would argue, 
our generation’s — genuflection before it. 

As part of his concern that sophisticated technology inspires a kind of secular 
idolatry, Adams also noted its increasing dominance as the hallmark of human 
progress. In particular, he presciently anticipated that it might erode the power of 
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both religion and the arts as vehicles for and markers of humanity’s higher striv- 
ings. Indeed, his experience at the Gallery taught him firsthand how fascination 
with such potent technology could eclipse appreciation of the arts: more specif- 
ically, of technological innovation replacing other modes of creative expression 
as the pinnacle of human achievement. Adams bemoaned the fact that his friend, 
Langley, who joined him at the exposition, “threw out of the field every exhib- 
it that did not reveal a new application of force, and naturally, to begin with, the 
whole art exhibit.” The progress of which technology increasingly claimed to be 
the yardstick extended beyond the valuation of art also extended to racial, ethnic, 
and gender scales. Most contemporary technological development, design, and 
impact continue to rely unquestioningly on enlightenment models of the “hu- 
man,” as well as the nearly unchanged and equally problematic metrics for human 
achievement, expression, and progress. 

These are not rhetorical analogies ; they are antecedences to AI, historical con- 
tinuities that may appear obscured because the tech-ecosystem tends to eschew 
history altogether: discourses about AI always situate it as future-facing, prospec- 
tive not retrospective. It is an idiom distinguished by incantations about growth, 
speed, and panoptic capture. The messy, recursive, complex narratives, events, 
and experiences that actually make up histories are reduced to static data points 
necessary in training sets for predictive algorithms. Adams’s reaction offers an 
alternative framing of time in contrast to marketing imperatives that fetishize the 
next new thing, which by definition sheds its history. 

This reframing is important to note because for all the contemporary talk of 
disruption as the vaulted and radical mode of innovation, current discourse still 
often presents so-called disruptive technologies as a step in an inexorable advance 
forward and upward. In that sense, tech disruption is in perfect keeping with the 
same teleological concept of momentum and progress that formed the founda- 
tional basis by which world’s fairs ranked not only modes of human achievement 
but also degrees of “human.” The exhibitions catalogued not just inventions but 
people, classifying people by emerging racialized typologies ona hierarchical scale 
of progress with the clear implication that some were more human than others.° 
This scale was made vivid and visceral: whether it was the tableaux vivant “ethnic 
villages” of the 1893 world’s fair in Chicago’s “White City” or the 1900 Paris show- 
case of African American achievement in the arts, humanities, and industry (im- 
ages of “racial uplift” meant to counter stereotyping), both recognized how pow- 
erfully influential were representations of races’ putative progress — or lack of it. 

Carrying the international imprimatur of the fairs, the exhibitions were acts 
of racial formation, naturalizing rungs of humanness and, indeed, universalizing 
the imbrication of race and progress. Billed as a glimpse into the future, the fairs 
simultaneously defined what was not part of modernity: what or who was irrele- 
vant, backward, regressive in relation. Technological progress, therefore, was not 
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simply represented alongside what (arts/humanities) or who (non-whites) were 
considered less progressive; progress was necessarily measured against both, in- 
deed constituted by its difference and distance from both. 

For critical theorist Homi Bhabha, such notions of progress, and the technol- 
ogy and symbol of it, are inextricably tied to the exercise of colonial and cultural 
power. His essay “Signs Taken for Wonders: Questions of Ambivalence and Au- 
thority Under a Tree outside Delhi, May 1817” critiques the “wondrous” presence 
of the book, itself a socially transformative technology, by beginning with the 
premise that innovation cannot be uncoupled from the prerogatives of those who 
have the power to shape realities with it: 


The discovery of the book is, at once, a moment of originality and authority, as well as a 
process of displacement, that paradoxically makes the presence of the book wondrous 
to the extent to which it is repeated, translated, misread, displaced. It is with the 
emblem of the English book — “signs taken as wonders” — as an insignia of colonial 
authority and an insignia of colonial desire and discipline that I begin this essay.” 


Adams spoke of awe in the presence of the dynamo. Bhabha goes further in 
challenging such “signs taken as wonders,” in questioning technologies so valo- 
rized that they engender awe, obeyance, and reverence as if such a response was 
natural, innocent of invested political and economic interests, free of market val- 
ue systems. 


Like all tools, AI challenges the notion that the skull marks the border of the 
mind. ...New tools breed new literacies, which can engender nascent forms of 
knowing, feeling and telling. 


—Vanessa Chang, “Prosthetic Memories, Writing Machines”® 


rt sits at the intersection of technology, representation, and influence. 
Literature, film, music, media, and visual and graphic arts are all crucial 
incubators for how publics perceive tech. Storytelling impacts, implic- 
itly or explicitly, everything from product design to public policy. Many of these 
narratives bear traces of literature’s earliest engagement with technology, at least 
since medieval times, and others — either engaged with AI or Al-enabled — are also 
offering new plotlines, tropes, identity formations, historiographies, and specula- 
tive futurities. Moreover, because cultural storytelling helps shape the civic imag- 
ination, it can, in turn, animate political engagement and cultural change.? 
Indeed, the arts are specially poised to examine issues in technological spaces 
(from industry to STEM education) of equity, diversity, social justice, and pow- 
er more capaciously and cogently than the sometimes reductive industry-speak 
of inclusion, fairness, or safety (usually simply meaning minimization of harm 
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or death -a low bar indeed). Even before GPT-3, powerful natural language 
processing was enabling explorations in Al-assisted poetry, Al-generated film- 
scripts, Al-informed musicals, Al-advised symphonies, Al-curated art histories, 
and Al-augmented music.'° Many are proposing new nomenclature for hybrid 
genres of art, design, and tech, and fresh subfields are blooming in both academe 
and entertainment." And during the COVID-19 pandemic and intensified move- 
ments for social justice, there has been a plethora of virtual exhibitions and arti- 
cles about the hot debates over the status, meaning, and valuation of Al-generated 
or -augmented art.” 

Amidst this explosion of artistic engagement with AI, social and political AI 
scholars Kate Crawford and Luke Stark, in “The Work of Art in the Age of Artifi- 
cial Intelligence: What Artists Can Teach Us about the Ethic of Data Practice,” of- 
fer a not uncommon perspective on the need for interdisciplinary collaboration: 
“Rather than being sidelined in the debates about ethics in artificial intelligence 
and data practices more broadly, artists should be centered as practitioners who 
are already seeking to make public the political and cultural tensions in using data 
platforms to reflect on our social world.” However, they also close the article 
by recommending that arts practitioners and scholars would do well with more 
technical education and that without it, their engagements and critiques will have 
lesser insight into and standing regarding the ethics of data practice: “One barrier 
to a shared and nuanced understanding of the ethical issues raised by digital art 
practices is a lack of literacy regarding the technologies themselves. . . . Until art 
critics engage more deeply with the technical frameworks of data art, their abil- 
ity to analyze and assess the merits of these works - and their attendant ethical 
dilemmas - may be limited.” They suggest: “a close relationship to computer sci- 
ence seemed to offer some artists a clearer lens through which to consider the eth- 
ics of their work. ”+4 

Certainly, continuing education is usually all to the good. But I would welcome 
the equivalent suggestion that those in data science, computer science, engineer- 
ing, and technology, in turn, should continue to educate themselves about aesthet- 
ics and arts practices — including at least a passing familiarity with feminist, queer, 
decolonial, disability, and race studies approaches to AI often central to those 
practices — to better understand ethical debates in their respective fields.'5 With- 
out that balance, the suggestion that artists and nontechnical laypeople are the 
ones who primarily need education, that they require technical training and cre- 
dentialing in order to have a valid(ated) understanding of and legitimate say in 
the political, ethical, social, and economic discussions about AI, is a kind of subtle 
gatekeeping that is one of the many often unacknowledged barriers to cross-dis- 
ciplinary communication and collaboration. Given the differential status of the 
arts in relation to technology today, it is usually taken for granted that artists (not 
technologists, who presumably are doing more important and time-consuming 
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work in and for the world) have the leisure and means not only to gain additional 
training in other fields but also to do the hard translational work necessary to in- 
tegrate those other often very different disciplinary practices, vocabularies, and 
mindsets to their own creative work. That skewed status impacts who gains the 
funding, influence, and means to shape the world. 

Instead of asking artists to adapt to the world models and pedagogies inform- 
ing technological training - which, as with any education, is not simply the neu- 
tral acquisition of skills but an inculcation to very particular ways of thinking and 
doing — industry might do well to adapt to the broader vernacular cultural practic- 
es and techne of marginalized Black, Latinx, and Indigenous communities. Doing 
so might shift conversation in the tech industry from simply mitigating harm or 
liability from the differentially negative impact of technologies on these commu- 
nities. Rather, it would require a mindset in which they are recognized as equal 
partners, cultural producers of knowledge(s), as the longtime makers, not just the 
recipients and consumers, of technologies.’® In fact, artist-technologist Amelia 
Bearskin-Winger, who is Haudenosaunee (Iroquois) of the Seneca-Cayuga Na- 
tion of Oklahoma, Deer Clan, makes a case that many of these vernacular, often 
generational, practices and values are what she calls “antecedent technologies,” 
motivated by an ethic that any innovation should honor its debt to those seven 
generations prior and pay it forward seven generations.'7 

In this way, many contemporary artist-technologists engage issues including, 
but also going beyond, ethics to explore higher-order questions about creativity 
and humanity. Some offer non-Western or Indigenous epistemologies, cosmol- 
ogies, and theologies that insist on rethinking commonly accepted paradigms 
about what it means to be human and what ways of doing business emerge from 
that. Perhaps most profoundly, then, the arts can offer different, capacious ways 
of knowing, seeing, and experiencing worlds that nourish well-being in the now 
and for the future. It is a reminder of and invitation to world models and frame- 
works alternative to what can seem at times to be dominating or totalizing tech- 
nological visions. In fact, one of the most oft-cited criticisms of AI discourse, de- 
sign, and application concerns its univision, its implied omniscience, what schol- 
ar Alison Adams calls “the view from nowhere.” It is challenged by art that offers 
simultaneous, multiple, specifically situated, and sometimes competing points of 
view and angles of vision that enlarge the aperture of understanding." 

For instance, informed by disability culture, Al-augmented art has drawn on 
GANs (generative adversarial networks) to envision non-normative, including 
neurodivergent, subjects that challenge taken-for-granted understandings of hu- 
man experience and capability. The presumption of a universal standard or nor- 
mative model, against which “deviance” or “deviation” is measured, is nearly al- 
ways implied to be white, cis-gendered, middle-classed, and physically and cog- 
nitively abled. That fiction of the universal subject- of what disability scholar 
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and activist Rosemarie Garland-Thomson terms the “normate” — has historical- 
ly shaped everything from medical practice and civil rights laws to built environ- 
ments and educational institutions. It also often continues to inform technolo- 
gies’ development and perceived market viability and use-value. Representations 
of “human-centered” technology that include those with mental or physical dis- 
abilities often call for a divestment from these usual ways of thinking and creat- 
ing. Such a direct critique is posed in art exhibitions such as Recoding CripTech. As 
the curatorial statement puts it, the installations reimagine “enshrined notions of 
what a body can be or do through creative technologies, and how it can move, look 
or communicate. Working with a broad understanding of technology... this mul- 
tidisciplinary community art exhibition explores how disability — and artists who 
identify as such — can redefine design, aesthetics and the relationship between 
user and interface.” Works included in Recoding CripTech that employ artificial in- 
telligence, such as M Eifler’s “Prosthetic Memory” and “Masking Machine,” sug- 
gest a provocative reframing of “optimization” or “functionality” in technologies 
that propose to augment the human experience.'9 


Race - racism — is a device. No More. No less. It explains nothing at all... . It is 
simply a means. An invention to justify the rule of some men over others. [But] it 
also has consequences; once invented it takes on a life, a reality of its own.... And 
it is pointless to pretend that it doesn’t exist — merely because it is a lie! 


—Tshembe in Les Blancs (1965) by Lorraine Hansberry 


ashaad Newsome'’s installation Being represents another artistic provoca- 

tion that reframes both the form and content of traditional technological 

historiographies often told from that “view from nowhere.” Newsome, a 
multimedia artist and activist, makes visible the erased contributions to technol- 
ogy and art by people of African descent. Newsome terms the interactive social 
humanoid Being 2.0 an “AI griot,” a storyteller. But unlike most social robots com- 
manded to speak, Being is intentionally “uppity”: wayward, noncompliant, disobe- 
dient, with expressive gestures drawn Black Queer vogue dance repertoire meant 
as gestures of decolonial resistance to the labor and service that social robots are 
expected to perform. It upends the historical association of robots and slaves (in 
the etymology of the Czech word, “robot” translates to “slave” ) in movement, af- 
fect, function, and speech. Taking aim at the limited training data sets used in nat- 
ural language processing, Newsome draws on broader archives that include Afri- 
can American vernacular symbolic systems.*° And since language carries cultural 
knowledge, Being’s speech expands not just vocabularies but reimagines how the 
standardized expressions of emotion and behavior often deployed in Al are racial- 
ly and culturally encoded.” In fact, Being is an attempt to redress the historical 


151 (2) Spring 2022 205 


This content downloaded from 
143.248.118.101 on Fri, 29 Sep 2023 09:31:43 +00:00 
All use subject to https://about.jstor.org/terms 


Signs Taken for Wonders : AI, Art & the Matter of Race 


Figure 2 
Rashaad Newsome’s Being 2.0 
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Being © Rashaad Newsome Studio. 


violence of antiquated notions about race, the more disturbing because the rep- 
resentations of race, reduced to seemingly self-evident graduations of color and 
physiognomy, are being actively resurrected in AI development and application. 

Race is always a negotiation of social ascription and personal affirmation, a 
process of what sociologists Michael Omi and Howard Winant term “racial for- 
mation.” Omi and Winant refer to racial formation as a way of historicizing the 
practices and circumstances that generate and renew racial categories and racial- 
izing structures: 
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We define racial formation as the sociohistorical process by which racial categories are 
created, inhabited, transformed, and destroyed. .. . Racial formation is a process of his- 
torically situated projects in which human bodies and social structures are represented 
and organized. Next we link racial formation to the evolution of hegemony, the way in 
which society is organized and ruled. . . . From a racial formation perspective, race is a 
matter of both social structure and cultural representation.”* 


The expression “racial formation” is therefore a reminder that race is not a 
priori. It is a reminder to analyze the structural and representational — not just lin- 
guistic — contexts in which race becomes salient: the cultural staging, political in- 
vestments, institutional systems, and social witnessing that grant meanings and 
values to categories. A full accounting of race therefore involves asking in whose 
interest is it that a person or people are racialized in any given moment in time and 
space? What function does it enable or disable? In short, what does it do? As Toni 
Morrison asks, the question should not be simply “is it racist?” but rather what 
does race — its presence or its conspicuous absence — make possible or eclipse ?73 

Overlooked, for instance, in many debates over racial bias, surveillance, and 
privacy in facial recognition technology is the practice of coding “race” or “eth- 
nicity” as fixed, static programmable variables, something writ on the face or 
otherwise available as physically intelligible - an outdated approach to race that 
harkens back to nineteenth-century phrenology and other pseudoscience map- 
pings of racial traits. Moreover, that practice renders opaque how categories are 
never merely descriptive, disinterested renderings of facts or things even though 
they cannot be purged of the value systems that animate their creation and make 
them intelligible for technological use -at least as currently developed — in the 
first place. Additionally, the claim to a universal objectivity is one of the “epistem- 
ic forgeries,” according to Yarden Katz, who describes it as one of the “fictions 
about knowledge and human thoughts that help AI function as a technology of 
power” because it enables “AI practitioners’ presumption that their systems rep- 
resent a universal ‘intelligence’ unmarked by social context and politics.”*4 That 
drive for comprehensive typing and classification, for a universal compendium, 
cannot easily accommodate race other than a technical problem in mapping vari- 
ation of types.”5 

To illustrate why AI representations are so problematic, let me take a seeming- 
ly innocuous example in the new algorithmic application “Ethnicity Estimate,” 
part of the Gradient app, which purports to diagnose percentages of one’s eth- 
nic heritage based on facial recognition technology (FRT). Such an app is signifi- 
cant precisely because popular data-scraping applications are so often pitched as 
convenient business solutions or benign creative entertainment, bypassing scru- 
tiny because they seem so harmless, unworthy of research analysis or quantita- 
tive study. Critically examining on such issues would be a direct impediment to 
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Figure 3 
Ethnicity Estimate and Facial Recognition Technology 
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Screenshot of the Ethnicity Estimate tool using FRT on one of my students, Edric Zeng, who is 
Korean and Chinese. Note his incredulous expression upon seeing its conclusion : 37 percent 
British ; 32 percent Ecuadorian ; 24 percent Serb; 7 percent Swede. Image courtesy of Edric Zeng. 


a seamless user experience with the product, thus designers and users are active- 
ly disincentivized from doing so. Like many such applications, Ethnicity Estimate 
problematically uses nationality as a proxy for ethnicity and reduces population de- 
mographics to blood quantum. 

Or consider Generated Photos: an Al-constructed image bank of “worry-free” 
and “infinitely diverse” facial portraits of people who do not exist in the flesh, which 
marketers, companies, and individuals can use “for any purpose without worrying 
about copyrights, distribution rights, infringement claims or royalties.”?° In cre- 
ating these virtual “new people,” the service offers a workaround for privacy con- 
cerns. Generated Photos bills itself as the future of intelligence, yet it reinscribes 
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Figure 4 
Generated Photos: “Use Your New Faces Anywhere!” 
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Source: Screenshot of promotional materials on https ://generated.photos/. 


the most reductive characterizations of race: among other parameters users can 
define when creating the portraits, such as age, hair length, eye color, and emotion 
through facial expression, the racial option has a dropdown of the generic homog- 
enizing categories Asian, African American, Black, Latino, European/white. 

Skin color options are similarly presented as self-evident and unproblematic 
givens, a data set based on an off-the-shelf color chart. There is a long racializ- 
ing history of such charts, from the von Luschan chromatic scale, used through- 
out the first half of the twentieth century to establish racial classifications, to the 
Fitzpatrick scale, still common in dermatologists’ offices today, which classifies 
skin types by color, symbolized by six smiling emoji modifiers. Although the lat- 
ter makes no explicit claim about races, the emojis clearly evoke the visuals well as 
the language of race with the euphemism of “pigmentary phototype.” 

All these types are readily serviceable as discrete data points, which makes 
them an easy go-to in algorithmic training, but the practice completely elides the 
fact that designations of “dark” or “light” are charged cultural and contextual in- 
terpretations that are always negotiated in context and in situ.*” The relevance and 
meaning of race emerge through social and cultural relations, not light frequen- 
cies. Fran Ross’s brilliant, satirical novel Oreo (1974) offers a wry send-up of at- 
tempts to apply color charts to social identities, shown as Figure 6.78 
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Figure 5 
The von Luschan Chromatic Scale (left) and the Fitzpatrick Scale (right) 
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The reproduction of the von Luschan chromatic scale, based on the chart first printed in Völker, 
Rassen, Sprachen (1927), is by Wikimedia users Dark Tichondrias and Cburnett. Printed under 
the Creative Commons Attribution-ShareAlike 3.0 Unported license. The Fitzpatrick scale is 
from John D’Orazio, Stuart Jarrett, Alexandra Amaro-Ortiz, and Timothy Scott, “UV Radia- 
tion and the Skin,” International Journal of Molecular Sciences 14 (6) (2013). Reprinted under the 
Creative Commons Attribution 3.0 Unported license. 


Table 1 
Fitzpatrick Type and von Luschan Scale 


Fitzpatrick Von Luschan Also Called 


Very light or white, “Celtic” type 


Dark or “brown” type 


Very dark or “black” type 


Source: Nina G. Jablonski, “Skin Coloration” in Human Evolutionary Biology, ed. Michael P. 
Muehlenbein (Cambridge: Cambridge University Press, 2010), 177. 
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Figure 6 
Fran Ross’s Oreo Color Scale 


Helen Clark: Singer, pianist, mimic, math freak (a 4 on the 
color scale). 


Colors of black people 
white j high yellow EEE yellow pesa 


| 2 3 4 
_light brown-skinned _brown-skinned + dark brown-skinned _ 
5 6 7 
dark-skinned | _very dark-skinned __ = Ss z 
8 9 10 


NOTE: There is no ‘‘very black.” Only white people use this term. 
To blacks, ‘‘black’’ is black enough (and in most cases too black, 
since the majority of black people are not nearly so black as your 
black pocketbook). If a black person says, ‘John is very black,” he 
is referring to John’s politics, not his skin color. 


Source: Fran Ross, Oreo (Boston: Northeastern University Press, 1974). 


Although new AI technologies show promise in diagnosing medical conditions 
of the skin, thinking of racial identification primarily in terms of chromatic scales 
or dermatoscopic data deflects attention, to put it generously, from the long history 
of the damaging associations of skin color and race that gave rise to early technolo- 
gies like this in the first place, whether it was the “science” of phrenology, IQ tests, 
or fingerprinting, and with implications, more recently, for the use of biometrics.”9 
At a minimum, it ignores the imbrication of “race” in pigmentocracies and color- 
ism, the historical privileging of light skin, and the various rationales for identify- 
ing what counts as “light-skinned.” Colorism, a legacy of colonialism, continues to 
persist in contemporary hierarchies of value and social status, including aesthetics 
(who or what is ranked beautiful, according to white, Western standards), moral 
worth (the religious iconography of “dark” with evil and “light” with holy contin- 
ues to saturate languages), social relations (for instance, the “paper bag test” of the 
twentieth century was used as a form of class gatekeeping in some African Amer- 
ican social institutions ),3° and the justice system (since social scientists have doc- 
umented the perceptual equation of “blackness” with crime, and thus those per- 
ceived as having darker skin as a priori criminally suspect). 

Why does this matter? Because it suggests that the challenges in represent- 
ing race in AI are not something technological advances in any near or far future 
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could solve. Rather, they signal cultural and political, not technical, problems to 
address. The issue, after all, is not merely a question of bias (implicit or other- 
wise), nor of inaccuracy (which might lead some to think the answer is simply 
the generation of more granular categories), nor of racial misrecognition (which 
some might hear as simply a call for ever more sophisticated FRT), nor even of 
ending all uses of racial categorization.3” It matters because algorithms trained on 
data sets of racial types reinforce color lines, literally and figuratively remanding 
people back in their “place.” By contrast, as I have suggested, the increasingly in- 
fluential rise of AI artist-technologists, especially those of color, are among those 
most dynamically questioning and reimagining the commercial imperatives of 
“personalization” and “frictionlessness.” Productively refusing colorblindeness, 
they represent race, ethnicity, and gender not as normative, self-evident catego- 
ries nor monetizable data points, but as the dynamic social processes — always in- 
dexing political tensions and interests - which they are. In doing so, they make 
possible the chance to truly create technologies for social good and well-being. 


Something has happened. Something very big indeed, yet something that we 
have still not integrated fully and comfortably into the broader fabric of our lives, 
including the dimensions — humanistic, aesthetic, ethical and theological — that 
science cannot resolve, but that science has also (and without contradiction) in- 
timately contacted in every corner of its discourse and being. 


—Stephen Jay Gould, The Hedgehog, the Fox, and the Magister’s Pox (2003 )3 


cite what may seem minor examples of cultural ephemera because, counter- 

intuitively, they hint at the grander challenges of AI. They are a thread reveal- 

ing the pattern of “something very big indeed,” as historian of science Ste- 
phen Jay Gould put it. Certainly there are ethical, economic, medical, educational, 
and legal challenges facing the future of AI. But the grandest technological chal- 
lenge may in fact be cultural: the way AI is shaping the human experience. Through 
that lens, the question becomes not one of automation versus augmentation, in 
which “augmenting” refers to economic productivity, but rather to creativity. 
That is, how can AI best augment the arts and humanities and thus be in service to 
the fullness of human expression and experience? 

This essay opened with Henry Adams’s moment of contact with the Dynamo’s 
“silent and infinite force,” as he put it, which productively denaturalizes the world 
as he knows it, suspends the usual epistemological scripts about the known world 
and one’s place in it. It is a sentiment echoed almost verbatim two hundred years 
later by Gould, witnessing another profound technological and cultural upend- 
ing. Writing at the turn into our own century, Gould, like Adams, cannot fully ar- 
ticulate the revelation except to say poignantly that “something has happened,” 
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that every dimension of “the broader fabric of our lives” is intimately touched by 
a technology whose profound effect cannot be “solved” by it. That liminal mo- 
ment for Adams, for Gould, and for us makes space for imagining other possibili- 
ties for human creativity, aesthetic possibilities that rub against the grain and mo- 
mentum of current technological visions, in order to better realize the “magiste- 
ria of our full being.” 34 


ABOUT THE AUTHOR 


Michele Elam is the William Robertson Coe Professor of Humanities in the De- 
partment of English, Faculty Associate Director of the Institute for Human-Centered 
Artificial Intelligence, the Bass University Fellow in Undergraduate Education, and 
a Race & Technology Affiliate at the Center for Comparative Studies in Race and 
Ethnicity at Stanford University. She is the author of The Souls of Mixed Folk: Race, 
Politics, and Aesthetics in the New Millennium (2011) and Race, Work, and Desire in Ameri- 
can Literature, 1860 — 1930 (2003) and editor of The Cambridge Companion to James Bald- 
win (2015). 


ENDNOTES 


1 Henry Adams, “The Virgin and the Dynamo,” in The Education of Henry Adams (Boston: self 
published, 1907). All of Henry Adams’s quotes are taken from the unpaginated PDF hosted 
by the University of Chicago at http ://geosci.uchicago.edu/~moyer/GEOS24705/2009/ 
HenryAdams.pdf. 


2? Unlike in The Wonderful Wizard of Oz, L. Frank Baum’s children’s book published the same 
year as the Paris Exhibition, for Adams, there is no reveal of the “man behind the cur- 
tain,” no Oz orchestrating a show. His interest is not in the technologists but in what 
ontological truths their creations tap. 


3 While there is no clear ethical or legal consensus on what constitutes “fairness,” there 
are critiques of fairness models that assume an equal playing field thwarting access to 
opportunities, that presume equal discrimination equals fairness, or that understand 
fairness in the narrowest sense of preventing harm (the critique of situating “fair- 
ness” under concerns of “safety”). For a review of some of the debates about fairness, 
see Michele Elam and Rob Reich, “Stanford HAI Artificial Intelligence Bill of Rights” 
(Stanford, Calif.: Stanford Institute for Human-Centered Artificial Intelligence, 2022), 
https ://hai.stanford.edu/sites/default/files/2022-01/Stanford%20HAI%20Artificial 
%20Intelligence%20Bill%200f%20Rights_o.pdf. 


4 Adams, “The Virgin and the Dynamo.” 


5 The “Prayer to the Dynamo” is a section within a longer poem by Henry Adams, Prayer 
to the Virgin of Chartres (1900), accessed through Teaching American History, https:// 
teachingamericanhistory.org/library/document/prayer-to-the-virgin-of-chartres/. 
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© On the question of humanness, and for an analysis of how technologies determine full 
humans, not-quite-humans, and nonhumans, see Alexander G. Weheliye’s excellent 
Habeas Viscus: Racializing Assemblages, Biopolitics, and Black Feminist Theories of the Human 
(Durham, N.C.: Duke University Press, 2014). See also Sylvia Wynter’s foundational 
essay, “Unsettling the Coloniality of Being/Power/Truth/Freedom: Towards the Hu- 
man, After Man, Its Overrepresentation—An Argument,” CR: The New Centennial Review 
3 (3) (2003): 257-337. Wynter critiques the overrepresentation of man (as white, West- 
ern) as the only imaginable mode of humanness, overwriting other ontologies, episte- 
mologies, and imaginaries. See also Katherine McKittrick, ed., Sylvia Wynter: On Being 
Human as Praxis (Durham, N.C. : Duke University Press, 2015). A major influence on this 
essay, Wynter’s pioneering and prolific work draws on arts, humanities, natural scienc- 
es and neuroscience, philosophy, literary theory, and critical race theory. 


N 


Homi Bhabha, “Signs Taken for Wonders: Questions of Ambivalence and Authority 
Under a Tree outside Delhi, May 1817,” Critical Inquiry 12 (1) (1985): 144. 


co 


Vanessa Chang, “Prosthetic Memories, Writing Machines,” Noéma, December 3, 2020, 
https ://www.noemamag.com/prosthetic-memories-writing-machines/. 


‘oO 


For instance, see the comment made by the then head of Instagram, Adam Mosseri, that 
his recent policy eliminating public “likes” -because of his concern “about the unin- 
tended consequences of Instagram as an approval arbiter” as he put it-was partly in- 
formed by an episode of the science fiction anthology television series Black Mirror. Amy 
Chozick, “This Is the Guy Who’s Taking Away the Likes,” The New York Times, January 
17, 2020, https ://www.nytimes.com/2020/01/17/business/instagram-likes.html. 


10 For example, see Google’s “Poem Portraits by Es Devlin,” https ://artsexperiments 


.withgoogle.com/poemportraits ?_ga=2.33161846.992826029.1556786810-799000725 
.1554196893. A 2016 short-film script entitled Sunspring was made by an AI bot. The 
main character in the filmed version was played by Thomas Middleditch, the same 
actor who plays the lead, Richard Hendriks, in the TV series Silicon Valley @. See also 
Al-generated musicals and symphonies, as in Maura Barrett and Jacob Ward, “AI Can 
Now Compose Pop Music and Even Symphonies. Here’s How Composers Are Joining 
In,” MACH by NBC News, May 29, 2019, https://www.nbcnews.com/mach/science/ 
ai-can-now-compose-pop-music-even-symphonies-here-s-ncna1010931. 


 Artist-technologists working at these intersections include Amelia Bearskin-Winger, 
Legacy Russell, Stephanie Dinkins, Ian Chang, Rashaad Newsome, Jacolby Satterwhite, 
Joy Buolamwini, Martine Syms, and others—not to mention those writers in the long 
literary history of speculative fiction. 


12 See, for instance, “Art at a Time Like This,” https ://artintimeslikethis.com/. I take up in 
detail the debates over the value and valuation of the arts and humanities in the age of 
artificial intelligence in Michele Elam, “GPT-3 in ‘Still I Rise!’: Why AI Needs Human- 
ists,” American Literature (forthcoming spring 2022). 


13 Luke Stark and Kate Crawford, “The Work of Art in the Age of Artificial Intelligence: 
What Artists Can Teach Us about the Ethics of Data Practice,” Surveillance & Society 17 
(3/4) (2019): 452. 


14 Ibid., 451-452. 


15 There are many academic and activist resources and collectives working in these areas, 
including Latinx in AI, Black in AI, Queer AI, Indigenous AI, and Accessible AI, to name 
but a few. 
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16 See, for instance, Ruha Benjamin, “Introduction: Discriminatory Design, Liberating 
Imagination,” in Captivating Technology: Race, Carceral Technoscience, and Liberatory Imagi- 
nation in Everyday Life, ed. Ruha Benjamin (Durham, N.C.: Duke University Press, 2019), 
1-25; and Nettrice R. Gaskins, “Creativity and Innovation across the African Diaspora 
and Global South,” in Captivating Technology, 252-253. 


17 Amelia Winger-Bearskin explains the concept in “Antecedent Technology: Don’t Colo- 
nize Our Future,” Immerse News, November 21, 2019, https ://immerse.news/antecedent 
-technology-b3a89956299d ; and Amelia Winger-Bearskin, “Before Everyone Was Talk- 
ing about Decentralization, Decentralization Was Talking to Everyone,” Immerse News, 
July 2, 2018, https ://immerse.news/decentralized-storytelling-d8450490b3ee. 


00 


1 


Alison Adams quoted in Yarden Katz, Artificial Whiteness : Politics and Ideology in Artificial In- 
telligence (New York: Columbia University Press, 2020), specifically in Katz’s discussion 
of AI notions of the self: “Practitioners in the 1970s, for instance, offered visions of 
the self as a symbolic processing machine. ... In the late 1980s and early 1990s, by con- 
trast, the prevailing ‘self’ started looking more like a statistical inference engine driven 
by sensory data. But these classifications mask more fundamental epistemic commit- 
ments. Alison Adams has argued that AI practitioners across the board have aspired to 
a ‘view from nowhere’ -to build systems that learn, reason, and act in a manner freed 
from social context. The view from nowhere turned out to be a view from a rather spe- 
cific, white, and privileged space.” Ibid., 6. See Alison Adams, Artificial Knowing: Gender 
and the Thinking Machine (Abingdon-on-Thames, United Kingdom: Routledge, 1998). 


19 See Rosemarie Garland-Thomson, Extraordinary Bodies: Representing Physical Disability in 
American Culture and Literature (New York: Columbia University Press, 1996). The cura- 
torial statement in Recoding CripTech explains the terminology: “the term ‘crip’ reclaims 
the word for disability culture and recognizes disability as a political and cultural iden- 
tity”; see Recoding CripTech, https://www.recodingcriptech.com/. See also M Eifler’s 
Prosthetic Memory (2020), https ://www.recodingcriptech.com/prosthetic-memory ; and 
Masking Machine (2018), https ://www.recodingcriptech.com/masking-machine. Many 
thanks to Lindsey Felt and Vanessa Chang, who produced and curated Recoding Crip- 
Tech, and especially for Lindsey’s suggestions for this section of the essay. 


20 


Su Lin Blodge and Brendan O’Connor, “A Racial Disparity in Natural Language Process- 
ing: A Case Study in Social Media African American English,” arXiv (2017), https:// 
arxiv.org/pdf/1707.00061.pdf. 


?1 See Neda Atanasoski and Kalindi Vora, “The Surrogate Human Affect: The Racial Pro- 
gramming of Robot Emotion,” in Surrogate Humanity: Race, Robots and the Politics of Tech- 
nological Futures (Durham, N.C. : Duke University Press, 2019), 108-133. 

22 Michael Omi and Howard Winant, Racial Formation in the United States, 2nd ed. (New York: 
Routledge, 1994), 55-56. 

233 Toni Morrison, Playing the Dark: Whiteness and the Literary Imagination (Cambridge, Mass. : 

Harvard University Press, 1992). 


2 


$ 


Katz, Artificial Whiteness : Politics and Ideology in Artificial Intelligence. The claim to universali- 
ty, according to Yatz, is the first forgery: “The second is that AI systems have matched 
or exceeded the capabilities of human thought ... [drawing] on deep-seated notions in 
Western culture about hierarchies of intelligence. The third epistemic forgery suggests 
that these computational systems arrive at truth, or ‘knowledge,’ ‘on their own,’ AI 
practitioners being merely the ones who set off the necessary conditions for computa- 
tional processes to properly unfold.” Ibid., 94-95. 
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32 


216 


Directly related to the issue of racial classification is the issue of racial and gender “am- 
biguity,” often (mis)understood in AI as simply a technical issue of documenting (or 
not) variance and managing uncertainty. For extended discussion of the complicated 
technical and political challenges posed by social identities transgressing racial or gen- 
der boundaries in AI, see Michele Elam, “Recoding Gender-Binaries and Color-Lines: 
Al and the Erasure of Ambiguity” in Feminist AI (forthcoming 2022). 


Generated Photos, https ://generated.photos/ (accessed December 17, 2021). 


By arguing for understanding words “in context,” I mean in the social science sense of 
meaning emerging through performative interaction, not meaning garnered by sentence- 
level “context,” as is commonly understood in natural language processing: that is, 
of other words that appear near each other in a sentence. Thanks to my Stanford col- 
leagues Chris Manning and Surya Ganguli for our conversations about natural lan- 
guage processing. 


Fran Ross, Oreo (Boston: Northeastern University Press, 2000), 5. First published in 1974 
by Greyfalcon House, Inc. 


This reduction of race to data points for AI has many problematic medical implications, 
even in work aiming to mitigate bias. Using self-reported racial data along with oth- 
er medical information to create a “phenotype,” Juan Banda acknowledges that racial 
porosity (people identifying with multiple races, differently over time, or differently 
in various contexts) as well as durational changes in aging mean up to 20 percent of 
data are thrown out in assessments. Moreover, as is long documented, race is often 
proxy for all sorts of other factors and inequities, so whether the data collected are 
self-reported or social ascription, it is still a highly problematic category. Juan Banda, 
“Phenotyping Algorithms Fair for Underrepresented Minorities within Older Adults,” 
Stanford HAI Weekly Seminar with Juan Banda, February 2, 2022, https ://philosophy 
.stanford.edu/events/hai-weekly-seminar-juan-banda-o. 


The “paper bag test,” and color discrimination broadly, is a complicated form of in- 
ternalized racism dating to slavery. Early scholarship suggested lighter-skinned slaves 
were supposedly treated better, although that view has been challenged, since being 
“in the Big House” instead of the field often meant greater exposure to sexual abuse. 
Moreover, there are many documented accounts of mixed race children-the issue of 
white masters and slaves—being sold away, often at the insistence of the white mistress 
of the house, since they stood as corporeal testimony to miscegenation and adultery-in 
short, to the sins of the father. 


See Jennifer Eberhardt, Biased : Uncovering the Hidden Prejudice that Shapes What We See, Think, 
and Do (London: Penguin, 2020). Eberhardt documents how police are more likely to 
think a suspect is holding a gun if they are perceived as “dark,” and that juries are more 
likely to negatively regard, and thus weigh judgment against, a defendant if they are 
considered “dark,” among the many other consequences. 


For instance, racial classification is often employed in the United States (though not in 
France and other countries) for strategic purposes generally understood as for the larg- 
er social good: for instance, by the Office of Management and Budget for census pur- 
poses, which are tied to the distribution of resources and the tracking of civil rights vi- 
olations, or by Federal Statistical Research Data Centers that enable the study of health 
and economic trends across demographics. In such cases, data collection of those gross 
categories is undertaken with the understanding that these are efforts to capture not 
inherent traits or types, but rather broad trends in the complex of race, gender, and 
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socioeconomics, among other variables. More recently, efforts to collect immigration 
and citizen status, neither following the prior intent nor practice of the Census, has 
made vivid the potential for misuses of this national mode of data collection. 


33 Stephen Jay Gould, The Hedgehog, the Fox, and the Magister’s Pox: Minding the Gap Between 
Science and the Humanities (Cambridge, Mass. : Belknap Press, 2011), 15. 


34 I am following Stephen Jay Gould’s critiques in The Hedgehog, the Fox, and the Magister’s 
Pox of E. O. Wilson and C. P. Snow’s notion of two cultures, described in Snow’s The 
Two Cultures and the Scientific Revolution as a split between science and humanities. Gould 
found that duality artificial, simplistic, and ahistorical, offering instead more accurate 
accounts of four historical periods exploring continuities of creative thinking across 
the sciences and humanities. 
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